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Abstract 

We previously reported the chaos induced by the frustration of interaction in a non-monotonic 
sequential associative memory model, and showed the chaotic behaviors at absolute zero. We 
have now analyzed bifurcation in a stochastic system, namely a finite-temperature model of the 
non-monotonic sequential associative memory model. We derived order-parameter equations from 
the stochastic microscopic equations. Two-parameter bifurcation diagrams obtained from those 
equations show the coexistence of attractors, which do not appear at absolute zero, and the disap- 
pearance of chaos due to the temperature effect. 
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I. INTRODUCTION 



Chaos occurs in systems that consist of chaotic or binary units. For instance, the globaUy 
coupled map and chaos neural networks consist of chaotic units, while neural 

networks consist of non-chaotic units. Although the processing units in neural networks are 
simple binary units, chaotic behavior can be observed at the macroscopic level. Chaotic 
behavior can be induced by various mechanisms: synaptic pruning, synaptic delay, thermal 
noise, sparse connections, and/or so on 0,0,0,0]. These models are deterministic systems. 
Chaotic behavior can also be observed in stochastic systems jo^. Using the Dale hypothesis, 
Fukai and Shiino \^ showed that chaos can occur in neural networks. 

Stochastic behavior can be distinguished from chaotic behavior based on the exponents, 
e.g., the Lyapunov exp onent . Therefore, analyzing deterministic chaos in stochastic systems 
is very interesting |lO, lll| . While there is a close relationship between microscopic behavior 
and macroscopic behavior, the macroscopic state cannot always be estimated from the mi- 
croscopic state. Frustration-induced chaos is an example of that. For continuous systems, 
chaotic behaviors in some small networks with frustration of interaction can be analyzed 
at the ..cosccp. leve, Q Q In so.e large .ndon, neura, network,, a dynamical 
mean-field theory was introduced to analyze chaotic behaviors by Sompolinsky et al. jisl . 
We have shown that chaos can be induced by frustration of interaction in a non-monotonic 
se,ue„t.alassoe,at,ve„.„dei0. 

The sequential associative memory model is a neural network in which the seq uence of 
patterns is embedded as an attractor through Hebbian (correlation) learning 2, 
When the number of patterns, is of the order 0{N)^ where is the number of processing 
units, the model has frustrated interactions [2^. The properties in stationary states were 
analyzed exactly using the path-integral method because the theoretical treatment 

of the transient was difficult. However, the transient of the model was recently rigorously 
analyzed Q|. 

The non-monotonicity of processing units (a larger absolute value of the local field tends 
to make their state opposite that of the local field) gives a system superior properties, 

a., enhanced storage capacity, fewer spurious states, and a super retrieval phase j2l|, |22, 
. The systems with non-monotonic units have chaotic behaviors. Dynamic theories are 
indispensable for analyzing the chaotic behaviors. The dynamical mean-field theory [3| is 
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exact in the limit of ^ oc, and one can analyze the chaotic behaviors in random neural 



networks. Only approximated theories, e.g., Gaussian approximation |16l. I23l. I24 1251. 1261. \21 

or steady-state approximation ^^Q, have been used to investigate the occurrence of these 
chaotic behaviors in the associative memory models. 

In our previous work j^, we constructed bifurcation diagrams of a non-monotonic system. 
We showed chaotic behaviors in a non-monotonic sequential associative memory model at 
absolute zero and demonstrated that the chaos occurs only when it has some degree of 
frustration. 

In this paper, we analyze bifurcations in our model at a finite temperature. We note 
that the microscopic behavior is stochastic while the macroscopic one is deterministic Q|. 
We can therefore analyze its macroscopic dynamics rigorously and construct two-parameter 
bifurcation diagrams from our order-parameter equations. The structure of the bifurcation 
is changed by the finite temperature effect. We analytically show the area of a cusp point 
and the coexistence of attractors, which do not appear at absolute zero. 



II. SEQUENTIAL ASSOCIATIVE MEMORY MODEL 

Consider a sequential associative memory model consisting of units or neurons. The 
state of the units takes cr^(t) = ±1 and is updated synchronously with probability 

Prob [a^{t + l)Mt)] = ^ [1 + (T^{t + 1)F {h,m , (1) 

N 

/i,(t) = 5;;j,,a,(t) + /,(t), (2) 

where Jij is the coupling, Ii{t) is the threshold or external input, and hi{t) is the local field. 
Function F (h) is a non-monotonic function given by 

F (h) = tanh Ph - tanh P {h - 9) - tanh (3 {h + 9) , (3) 

where (3 is the inverse temperature (/? = l/T), and 9 is the non-monotonicity. When T = 0, 
the update rule of the model is deterministic: 

a,{t + 1) = sgn {h,{t)) - sgn {h,{t) -9)- sgn {h,{t) + 9) . (4) 

When the absolute value of the local field is larger then 6^, the sign of the state is opposite 
that of the local field, i.e., Gi{t + 1) = —sgn {hi{t)). Coupling Jij stores p random patterns, 
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= (<^^, • • • , <^^)^, so as to retrieve the patterns sequentially: ^ ^ • • • ^ ^ It 
is given by 

12=0 

where = The number of stored patterns is given hjp = aN ^ where a is the loading 
rate. Each component of the patterns is assumed to be an independent random variable 
that takes a value of either +1 or —1 based on 

Prob[ef = ±1] = ^. (6) 

We determine the initial state, cr(0), based on 

P.ob[..,0) ^ ±1] ^ 

The overlap, the direction cosine between cr(0) and converges to m(0) as ^ oc. 



III. MACROSCOPIC STATE EQUATIONS 

To discuss the transient, we introduce macroscopic state equations by using the path- 
integral method 18, 3l. Generating function is defined as 



P k(0), o-(l), . . . , a{t)] exp I -I ^(^) • ^{s) ) , 
]),•••, crm \ s<t / 



Zm = P [^(0), ^(1), • • • , CT{t)] exp ( > ^ a{s) • ) , (8) 

o-(o),...,cr(t) 

where i/j = ('0(0), • • • , '0(t — 1)). State a{s) = (cri(5), • • • , o-n{s))^ denotes the state of the 
spins at time 5, and path probability p [cr(0), cr(l), • • • , cr{t)] denotes the probability of taking 
the path from initial state cr(0) to state a{t) at time t through cr(l), cr(2), • • • , a{t — l). Since 
the dynamics, eq. (P), is a Markov chain, the path probability is given by 



p [a{0), a{t)] = p [^(0)] J] J] 1 [1 + + 1)F {h,{s))] . (9) 

s<t i 

The generating function involves the following order parameters: 



Gis, s') = ^ lim i- y (11) 



Order parameter m{s) corresponds to the overlap, which represents the direction cosine 
between state a{s) and retrieval pattern at time s. G{s^ s') and C{s^ s^) are the response 
and correlation functions, respectively, between time s and s\ Therefore, the problem of 
evaluating the macroscopic dynamics leads to the problem of evaluating the generating 
function. 

We consider the case of thermodynamic limit ^ oc and analyze Z[iIj] using the saddle 
point method. Since ^ oc and stored patterns are random patterns, we can assume 
self- averaging with respect to the realization of disorder; that is, we would like to average 
Zhb]gyeT the uncondensed patterns. And then using the normalization condition Z [0] = 1 
(28l . |29|, we can eliminate invalid order parameters and derive effective order parameters. 
We can therefore obtain a rigorous solution using the path-integral method Q|. 

Finally, we obtain the following macroscopic state equations from Z[iIj] when Ii{s) = 0: 

m{s) = (^C j D,F {i'm{s - 1) + z^aR{s - l,s - I)) ^ , (13) 
i?(s, s') = C(s, s') + G(s, s - l)G(s', s' - l)R{s - 1, s' - 1), (14) 
G{s,s-1) = 



^^aR{s — 1, s — 1) 
JDzzF (^Cmis - 1) + z^/aR{s - 1, s - 1))^ , (15) 



Ci.s,s) = ( / — ,^ , 1 exp 



— z ■ z 



F (f m(5 - 1) + ^z{s - 1)) 



27i\Rii\ 

xF (^C'm{s' - 1) + V^^s' - 1)) )^ , (16) 

where = exp[— and (•)^ denotes the average over all (^'s. Matrix Ru is a 2 x 2 
matrix consisting of the elements of R at times s — 1 and 5^ — 1, and z = [z{s — 1), z{s' — 1)]^. 
From eqs. (IIS|)-(Iin|), C{s, s') = and R{s, s') = when s ^ s\ Since G{s, s-1) and C{s, s) 
can be described using only m{s — 1) and R{s — 1,5 — 1), macroscopically this system 
is a two-degree-of-freedom system of m{s) and R{s^s). Since we can easily calculate the 
Gaussian integrals, we can analyze the transient dynamics exactly even if the network fails 
in retrieval. We note that 771(5) is an odd function and R{s^ s) is an even function, since the 
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function F{h) is an odd function. Therefore, the map by the macroscopic state equations is 
hne symmetric with respect to the hne m = 0. 

Besides these dynamic macroscopic state equations, the fixed points of the system are 
required in order to analyze the bifurcation of the system. We set m{t) m, t — 1) G 
and R{t^t) r when t ^ oo. Then, the previously obtained stationary state equations 
jirl . Q| are re-derived using our dynamic theory: 

^ = (^^J D.FlCm + zV^]'^ , (17) 

G = -^^j D,zF[im + z^]^ , (18) 

(19) 



1-G2- 



IV. MACROSCOPIC DYNAMICS 



We can obtain the macroscopic dynamics f[T!H) " f[T?)j) from the stochastic microscopic dy- 
namics. Moreover, the Jacobian matrix, J{s)^ can be easily calculated from these equations: 



J{s) 



dm{s) dm{s) 

dm{s-l) dR{s-l,s-l) 
dR{s,s) dR{s,s) 

dm{s-l) dR{s-l,s-l) 



(20) 



We can therefore classify fixed points according to their eigenvalues, A. We analyze the 
transient for a finite temperature, e.g., T = 0.10. Figure shows the transition of the 
overlap, m(t), and the variance of the crosstalk noise, aR{t^ t). The graphs show the results 
obtained using (a) our theory and (b) computer simulation with = 100, 000, where loading 
rate a is 0.065 and non-monotonicity 6 is 1.20. The cross marks (P, P^, Q) are fixed points. 
Point P is a repellor (unstable focus), since the eigenvalues are A = —0.21 ± 1.40i; P' is a 
repellor (unstable node) because A = —1.30, 1.18; and Q on line m = is a saddle node 
(orientation reversing) because A = —1.29,0.91. There is a period-2 attractor, (52, that 
attracts the trajectories with initial state m(0) 0. Moreover, there is a chaotic attractor 
around repellor P. The results obtained using our theory agree with those using computer 
simulation. Since our dynamic macroscopic state equations are derived exactly, the difference 
between the theoretical analysis and the computer simulation is due to finite size effect. 
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V. BIFURCATION DIAGRAM FOR T = 



We investigated the relationships of the invariant sets shown in Fig. in two-parameter 
space with respect to {9^ a). Line m = is an invariant set of the macroscopic state 
equations, and the map of the system is hne symmetric with respect to invariant hne m = 0, 
as stated above. The dynamic structure on this invariant hne obeys a one-dimensional map 
with respect to R{t^t) [8]. Figure El (a) shows a two-parameter bifurcation diagram for the 
attract or on invariant line m = 0, and (b) shows one for the attract or around repellor P 
for T = 0. The blue region represents the period-1 attractors, red period-2, green period-3, 
yellow period-4, purple period-5, sky blue period-6, and black for more than six periods, 
quasi-periodic or chaotic. In Fig. (a), as 9 decreases, a period-1 attractor, Q, bifurcates 
to a period-2 attractor, (52, and evolves into a chaotic attractor due to the period-doubling 
cascade. In Fig. (b), some regions are denoted by A, A^^ 5, B\ C, and and we can find 
bifurcations on the boundaries between these regions. 

A. Transient 

Figure El shows the transient in regions A and A\ There is only a period-1 attractor, 
on the invariant line. Since the map by our macroscopic state equations is irreversible, there 
is an orientation-preserving area inside the semielliptical arc, and an orientation-reversing 
area outside the arc. The orientation-preserving area shrinks as 9 decreases. Therefore, the 
transient in A differs from that in A\ In both cases, since the stored patterns are unstable, 
the associative memory fails to retrieve one from any initial state. 

Figure^ shows the transient in regions B and B\ In region 5, there is both a period-1 
attractor, Q, on the invariant line and a period-1 attractor, P, near m = 1. The orientation- 
reversing area is far from the origin. In this case, since the stored patterns are stable, 
the associative memory can retrieve one when the state is in the basin of the attraction of 
P. Additionally, in region 5', there is both attractor Q and period-2 attractor P2. The 
orientation-preserving area shrinks to near the origin. Attractor P2 is a sign-reversing state 
near line m = ±1. In this case, the stored patterns are unstable, and the memory retrieves 
the stored pattern and its reverse one in turn when the state is in the basin of attraction of 
P2. 
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Figure El shows the transient in region C. There is both a period-2 attractor, (52, on 
the invariant hne and a certain attractor near m = 1. The attractor around repeUor P is 
periodic, quasi-periodic, or chaotic. In this case, although the stored patterns are unstable, 
there is a quasi-periodic or chaotic attractor. The state, therefore, goes to this attractor 
instead of the memory state. Since the overlap is non-zero, the associative memory neither 
completely succeeds nor fails to retrieve patterns. 

Figure El shows the transient in region D. There is a period-1 attractor, Q, and a period-2 
attractor, (52, on the invariant line. In this case, since the stored patterns are unstable, the 
associative memory fails to retrieve one from any initial state. 

B. Bifurcations 

The coexistence, as stated above, can be explained by the occurrence of characteristic 
bifurcations on the boundary between regions. On boundary A ^ saddle node and 
period-1 attractor P are generated by the saddle node bifurcation, leading to the existence of 
both Q and P. They are separated by the basin boundary constituted by P^ The boundary 
B ^ A represents the storage capacity, i.e., the critical loading rate. On boundary A B' ^ 
similarly, period-2 saddle node P2 and period-2 attractor P2 are generated by the saddle node 
bifurcation, leading to the existence of both Q and P2. In contrast, on boundary B ^ C ^ 
period-1 attractor P evolves into a repellor due to the Hopf bifurcation, and a quasi-periodic 
attractor is generated around the repellor. This attractor is sometimes phase-locked, and 
then it evolves into a more complex quasi-periodic attractor by the Hopf bifurcation a gain . 
The repellor inside the quasi-periodic attractor then evolves into a snap-hack repellor (30|, 
and belt-like chaos appears. Finally, the chaos spreads and becomes a thick chaotic attractor, 
including repellor P. On boundary C ^ the chaotic attractor disappears due to a 
boundary crisis because it comes into contact with the basin boundary constituted by 
P' . Therefore, in region there is only period-2 attractor Q2 on the invariant line. 

VI. BIFURCATION DIAGRAM FOR T > 

We constructed two-parameter bifurcation diagrams for several finite temperatures. Fig- 
ure [3 shows the diagrams for an attractor on invariant line m = for T = 0.0 — 0.35. The 
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abscissa denotes ^ (0 < ^ < 1.7), and the ordinate denotes a {0 < a < 0.302) on a loga- 
rithmic scale. In the center of the diagrams, we can find another bistable region in which 
attractors coexist. As the temperature is increased, the bistable region becomes larger. For 
T > 0, there is a fishhook structure where the region of each periodic attractor divides into 
two regions. When T > 0.30, the more-than-two-period attractors and chaotic attractors 
disappear. 

Figure [HI shows the two-parameter bifurcation diagrams for fixed point P or of the attrac- 
tors around P for T = 0.0 — 0.40. The diagrams overlay those in Fig.[Z|since one can see the 
coexistence of attractors P and Q. As the temperature is increased, the Hopf bifurcation 
set becomes an isolated circle and disappears via the codimension-2 bifurcation set. Since 
a fishhook structure is evident in the diagram, there is a cusp point, i.e., a codimension-2 
bifurcation set, which generates a pair of saddle node bifurcation sets. 

We show the region where the cusp point exists. Figure [HI shows the two-parameter 
bifurcation diagrams for fixed point which are graded by eigenvalue A. The bright lines 
denote eigenvalue A = 0. There is only one curve for A = at T = 0, whereas there are two 
for T = 0.05. A cusp point is in the region surrounded by the curves. 

VII. DISCUSSION 

We can see that the chaotic region may be expanding to a ^ in Figs. [3 and [HI We 
first discuss the cases oi a = and a ^ 0. Only one order-parameter, m(t), dominates the 
macroscopic behaviors of the present system without frustration of interaction, that is, when 
the number of stored patterns is finite {a = 0). We can easily show that there is no chaotic 
attractor in this case. A chaotic attractor appears when the system has frustration, i.e., 
a ^ 0. While the local field, /ii(t), obeys a 5-function distribution when a = 0, it obeys a 
Gaussian distribution with variance aR{t^ t) when a ^ Q. We show the simple case of T = 
and m{t) = 0. From eqs. (^, ffT^ . and ffT5j) . the variance of crosstalk noise, aR{t+ 1, t + 1), 
can be given by 




(21) 



When a ^ 0, aR{t + 1, t + 1) converges to 




(22) 
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since t) takes a large value in inverse proportion to a. That is, aR{t + l^t + l) still takes 
a finite value even if a ^ 0. Figure fTUI shows the return map of aR{t^ t) for T = and 0.3. 
We can see that the fixed point is finite {aR{t^ t) > 0). Because of this finite variance of the 
local field distribution, the processing units, whose absolute values of local field hi{t — 1) 
are around non-monotonicity 0, take different values, similar to those in Bakers' Map. This 
is the reason for the occurrence of chaos in this model with frustration. Non-trivial findings 
are that chaos also appears when a ^ and that the phase is completely different from 
when a = 0. 

Next we discuss the reason for the change in the bifurcation structure due to the finite 
temperature effect. We consider the case of an attract or on m(t) = 0. Since fixed point Q is 
on invariant line m = 0, the dynamics obeys a one-dimensional map with respect to t). 
Figure fTTl shows the return map of R{t^t). For T = (solid line), the map is unimodal and 
there is a period-2 attractor, whereas the map is bimodal and there is a period-4 attractor 
for T = 0.1 (broken line). Therefore, the finite temperature effect changes the bifurcation 
structure, causing a bistable region to appear. When T is large enough, the more-than- 
two-period attractors and chaotic attractors disappear. Thermal noise, therefore, orders the 
system. The ordering mechanism may be similar to that of noise-induced order Q, 

In summary, we considered a sequential associative memory model consisting of non- 
monotonic units, which is a stochastic system, and derived macroscopic state equations using 
the path-integral method in the frustrated case. The results obtained by theory agreed with 
the results obtained by computer simulation. We constructed two-parameter bifurcation 
diagrams for various temperatures and used them to explain the changes in the structure of 
the bifurcations caused by the temperature effect and the coexistence of attractors. 
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FIG. 1: Transition of overlap m{t) and variance of crosstalk noise aR{t,t) for a = 0.065,0 = 
1.20, T = 0.10. Fixed points P,P\Q are from stationary state equations: (a) our theory, (b) 
simulation (TV = 100,000). 




FIG. 2: Two-parameter bifurcation diagram (0, a) for (a) fixed point Q and (b) fixed point P at 
T = 0. Blue region represents period-1 attractors, red period-2, green period-3, yellow period-4, 
purple period-5, sky blue period-6, and black for more than six periods, quasi-periodic or chaotic. 
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FIG. 3: Attractor Q in (a) region A {a ^ 0.30, 6> = 1.20) and (b) region A' {a = 0.30, 6> = 0.70) at 
T = by our theory. Area inside semielliptic arc is orientation-preserving area, and area outside 
is orientation-reversing area. 




FIG. 4: Attractors P and P2 in (a) region B {a ^ 0.20, 9 = 1.50) and (b) region B' {a = 0.20, 9 = 
0.20) at T = by our theory. 
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FIG. 5: Attractors around P in region C: (a) quasi-periodic attractor {a = 0.10,0 = 1.30), (b) 
period-6 attractor {a = 0.01,0 = 1.20), and (c) chaotic attractor {a = 0.10,0 = 1.15). 




FIG. 6: Attractors around P in region D (a = 0.10, 6 = 1.00) vanish due to boundary crisis. 
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(g) T = 0.30 



(h) T = 0.35 



FIG. 7: Two-parameter bifurcation diagrams on invariant line m = for (a) absolute zero {T — 0) 
and (b)-(h) finite temperature {T — 0.05 — 0.35). Abscissa denotes 6 {0 < < 1.7), and ordinate 
denotes a {0 < a < 0.302) on logarithmic scale. Colors denote period of attractors as in Fig. El 
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9 l-^ 1.7 

(c)r = 0.15 (d)r = 0.25 




9 1.7 9 1.7 

(g) T = 0.35 (h) T = 0.40 



FIG. 8: Two-parameter bifurcation diagrams around fixed point P for (a) absolute zero (T = 0) 
and (b)-(h) finite temperature (T = 0.05 — 0.40). Abscissa denotes ^ (0 < ^ < 1.7), and ordinate 
denotes a {0 < a < 0.302) on logarithmic scale. Colors denote period of attractors as in Fig. El 
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FIG. 9: Curve of eigenvalue A = and area of cusp point for (a) T = and (b) T = 0.05. Cusp 
point is in rectangular area. 
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FIG. 10: Return map of variance of crosstalk noise, aR{t,t) for a = 0.001,0 = 1.0. Solid and 
broken lines denote cases of T = and T = 0.3, respectively. 
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FIG. 11: Return map of R{t,t) for a = 0.01, 6> = 0.8. Solid and broken lines denote cases 
and T = 0.1, respectively. 
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